Papers by Murali Krishna Ramanathan

8 papers
ReCode: Robustness Evaluation of Code Generation Models (2023.acl-long)

Copied to clipboard

Challenge: Existing work on robustness in text or code tasks has focused on classification, while robustness for code generation tasks is an uncharted area.
Approach: They propose a robustness evaluation benchmark for code generation models that customizes over 30 transformations specifically for code on docstrings, function and variable names, code syntax, and code format.
Outcome: The proposed model performs better on human annotators and on SOTA models with human annnotators.
A Static Evaluation of Code Completion by Large Language Models (2023.acl-industry)

Copied to clipboard

Challenge: Large language models trained on code have shown great potential to increase productivity of software developers.
Approach: They propose a static evaluation framework to quantify static errors in Python code completions by leveraging Abstract Syntax Trees.
Outcome: The proposed framework is more efficient and applicable to code in the wild.
LibEvolutionEval: A Benchmark and Study for Version-Specific Code Generation (2025.naacl-long)

Copied to clipboard

Challenge: Recent code completion models focus on local file contexts, but do not fully capture the complexities of real-world software development.
Approach: They propose a version-specific code-completion task across eight libraries as they evolve over the years and an in-depth analysis of two widely used public libraries: PyTorch and Matplotlib.
Outcome: The proposed model improves performance with public libraries, compared with existing models.
CODESTRUCT: Code Agents over Structured Action Spaces (2026.acl-long)

Copied to clipboard

Challenge: LLM-based code agents treat repositories as unstructured text, fail to produce valid patches . authors propose a structure-aware interface that exposes a codebase as a programmable action space .
Approach: They propose to reframe the codebase as a structured action space where agents operate on named AST entities rather than text spans.
Outcome: Evaluated on six LLMs, the proposed framework improves Pass@1 accuracy by 1.2-5.0% and reduces token consumption by 12-38%.
SpecAgent: A Speculative Retrieval and Forecasting Agent for Code Completion (2026.acl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel at code-related tasks but struggle in real software repositories.
Approach: They propose a large-scale agent that injects repository context at inference time to improve both latency and code-generation quality by proactively exploring repository files during indexing and constructing speculative context.
Outcome: Experiments show that SpecAgent achieves 9–11% relative performance gains compared to baselines while significantly reducing inference latency.
Exploring Continual Learning for Code Generation Models (2023.acl-short)

Copied to clipboard

Challenge: Large-scale code generation models such as Copilot and CodeT5 are expensive to train and re-train.
Approach: They propose a benchmark for Continual Learning (CL) that covers a wide range of tasks with different input and output programming languages.
Outcome: The proposed method improves on Prompt Pooling with Teacher Forcing, which suffers catastrophic forgetting due to stark distribution shifts in coding tasks.
CodeFort: Robust Training for Code Generation Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing research efforts to improve code generation models are inadequate . code generation model performance is degraded under small perturbations .
Approach: They propose a framework to improve the robustness of code generation models by generalizing code perturbations to enrich training data and enabling various robust training strategies.
Outcome: The proposed framework increases pass rates and robustness drop rate against code-syntax perturbations.
CoCoMIC: Code Completion by Jointly Modeling In-file and Cross-file Context (2024.lrec-main)

Copied to clipboard

Challenge: Pre-trained language models (LMs) for code have shown promising performance in code completion tasks but ignore the rich semantics in other files within the same project.
Approach: They propose a framework that jointly learns the in-file and cross-file context on top of code LMs and a static-analysis-based tool that locates and retrieves the most relevant project-level cross- file context for code completion.
Outcome: The proposed framework improves existing code LMs with a 33.94% relative increase in exact match and 28.69% in identifier matching when the cross-file context is provided.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations